Algorithmic information and simplicity in statistical physics
نویسندگان
چکیده
منابع مشابه
Algorithmic information and simplicity in statistical physics
Given a list of N states with probabilities 0 < p1 ≤ · · · ≤ pN , the average conditional algorithmic information Ī to specify one of these states obeys the inequality H ≤ Ī < H + O(1), where H = − pj log2 pj and O(1) is a computer-dependent constant. We show how any universal computer can be slightly modified in such a way that the inequality becomes H ≤ Ī < H + 1, thereby eliminating the comp...
متن کاملAlgorithmic Simplicity and Relevance
The human mind is known to be sensitive to complexity. For instance, the visual system reconstructs hidden parts of objects following a principle of maximum simplicity. We suggest here that higher cognitive processes, such as the selection of relevant situations, are sensitive to variations of complexity. Situations are relevant to human beings when they appear simpler to describe than to gener...
متن کاملStatistical Physics and Information Theory
This is a set of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism between Inform...
متن کاملInformation Theory and Statistical Physics
Relationships between information theory and statistical physics have been recognized over the last few decades. One such aspect is identifying structures of optimization problems pertaining to certain information-theoretic settings and drawing analogy to parallel structures arising in statistical physics, and then borrowing statistical mechanical insights, as well as powerful analysis techniqu...
متن کاملInformation Theory and Statistical Physics - Lecture Notes
This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism betwe...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Theoretical Physics
سال: 1997
ISSN: 0020-7748,1572-9575
DOI: 10.1007/bf02435782